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PREFACE 


This  research  and  development  effort  was  conducted  under  Work 
Unit  77191845  which  is  dedicated  to  the  selection  and  classification  of 
USAF  aircrew  personnel.  The  authors  thank  Maj  David  Perry,  Dr.  Joseph 
L  Weeks,  and  Dr.  William  E,  Alley  for  their  comments. 
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PILOT  CANDIDATE  SELECTI-^N  METHOD  (PCSM': 
WHAT  MAKES  \  TRK? 


SNTRODUCTION 

Modern  high-performanr  jet  aircraft  place'  heavy  demands  on  Air  Force  pilot's 
physical  condition,  psychomotor  coordination,  and  cognitive/perceptual  abilities.  The 
ioentification  of  candidates  mos+  likely  to  succeeJ  as  Air  Force  pilots  has  been  a  long 
standing  goal  vBordelon  &  Kuntor,  1986;  Carretta,  1989,1990,  1992;  Hunter  & 
Thompson,  1978;  Long  &  Varney,  1975;  McGrevy  &  Valentine,  1974;  Miller,  1947; 
Morales  <-1  Ree,  1992-  Ree,  1976;  Stoker,  Hunter,  Kant^r,  Quebe,  &  Siem,  1987).  The 
variables  currently  ^nside  i  in  pilot  candidate  selection  include  medir  M  and 
p  sical  fitness,  college  performance,  paper-and-pencil  aptitude  test  scores  (e.g..  Air 
Force  Officer  Qualifying  Test  (AFOOT);  see  Skinner  &  Ree,  1987  for  a  description),  and 
previous  flying  expe^'nnce. 

Air  Training  Command  has  initiated  se  'al  programs  that  will  significantly 
change  the  process  by  which  Air  Force  pilot  a  dates  are  selected,  classified,  and 
trained.  The  changes  are  a  result  of  policy  deci.  5  (a)  to  convert  from  a  generalized 
undergraduate  pilot  training  (UPT)  system  to  a  specialized  undergraduate  pilot 
tr  ining  (SUPT)  system,  (b)  to  classify  pile  -landida^es  into  specialized  training  tracks 
(bomber/fighter  or  tankerAransport)  at  the  id  of  T-37  (initial  jet  trainer)  training,  an^ 
(c)  to  operationally  implement  a  recently  validated  computer-based  pilot  candidate 
selection  instrument  (Basic  Attributes  Test  (BAT):  'ee  Carretta,  1987  for  a  description). 

The  Pilot  Candidate  Select  n  Method  (PCSM)  is  the  SUPT  subcomponent  by 
which  the  Air  Fome  will  select  pilot  candidates.  The  gc-''  of  PCSM  is  to  identify  the 
best  qualified  pilot  training  applicants  and  to  reduce  ar  on.  The  PCSM  algorithm 
combines  scores  from  the  AFOOT  and  BAT  with  previous  flying  experie  e  to  predict 
flying  training  performance  and  ranks  applicants  on  probable  suci.  .s  in  flying 
training. 

Several  studies  have  demonstrated  the  incremental  validity  of  the  BAT  when 
used  with  AFOOT  and  other  current  pilot  selection  measures  (Bordelon  &  Kantor, 
1986;  Carretta,  1989,  1990;  Kantor  8  G.  Jtta,  19C8).  Operational  implemQnt''tion  of 
PCSM  is  expected  to  begin  in  1993  following  purchase  of  BAT  '  stems. 

The  purpose  of  this  study  was  to  ♦ermine  what  makes  tf  PCSM  algorithm 
work;  that  is,  what  are  the  sources  of  its  ^.-edictive  utility?  A  better  understanding  of 
the  relationships  among  the  PC  M  com’'  ents  and  pilot  training  performance  is 
needed  to  facilitate  development  of  n  generation  pilot  candidate  selection 
instrumer 
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METHOD 


Subjects 

The  subjects  were  678  pilot  trainees  in  the  United  States  Air  Force.  They  were 
mostly  male  (98%),  White  (90%),  and  all  were  college  graduates  between  the  ages  of 
23  and  27.  All  pilot  trainees  had  been  selected  for  pilot  training  on  the  basis  of  scores 
on  an  aptitude  test  (AFOOT),  educational  attainment,  physical  standards,  and  a  desire 
to  fly.  Although  all  trainees  had  the  opportunity  to  decline  participation  in  the  study, 
none  did. 

Measures 

The  AFOOT  is  a  cognitive  paper-and-pencil  multiple-aptitude  battery.  The 
battery  is  comprised  of  16  tests  measuring  psychometric  g  (Earles  &  Ree,  1931)  and 
the  common  factors  of  verbal,  quantitative,  spatial,  perceptual  speed,  and  aircrew 
aptitude/interest  (Skinner  &  Ree,  1987).  The  tests  are:  Verbal  Analogies  (VA), 
Arithmetic  Reasoning  (AR),  Reading  Comprehension  (RC),  Data  Interpretation  (Dl), 
Word  Knowledge  (WK),  Math  Knowledge  (MK),  Mechanical  Comprehension  (MC), 
Electrical  Maze  (EM),  Scale  Reading  (SR),  Instrument  Comprehension  (IC),  Block 
Counting  (BC),  Table  Reading  (TR),  Aviation  Information  (Al),  Rotated  Blocks  (RB), 
General  Science  (GS),  and  Hidden  Figures  (HF).  All  tests  were  scored  with  number 
right. 

The  tests  are  aggregated  into  the  5  composites  of  Verbal,  Quantitative, 
Academic  Aptitude,  Navigator-Technical,  and  Pilot.  These  composites  are  used  in  the 
commissioning  of  officers  through  the  Reserve  Officer  Training  Corps  (ROTC)  and  the 
Officer  Training  School  (OTS).  The  composites  are  also  used  to  select  candidates  for 
pilot  and  navigator  training. 

"he  BAT  is  a  computer-administered  battery  of  tests  measuring  psychomotor 
skills,  information  processing,  and  attitude  toward  risk  which  has  b'  )n  validated  for 
selection  of  candidates  for  pilot  training  (Carretta,  1989,  1990,  199'  .  The  BAT  was 
administered  with  a  special  alpha-numeric  keypad,  a  monochrome  monitor,  and  two 
control  (joy)  sticks.  A  detailed  description  of  the  BAT  was  provided  by  Carretta  (1987). 

The  first  psychomotor  test  was  a  rotary  pursuit  task  called  Two-Hand  Coordina¬ 
tion,  an  example  of  Fleishman's  multilimb  coordination  (Fleishman  &  Quaintance, 
1984).  In  this  test  the  subject  used  right  and  left  hand  control  sticks  to  keep  a  circle  on 
a  representation  of  an  airplane  as  it  moved  in  an  ellipse  on  the  computer  monitor.  The 
score  was  horizontal  tracking  distance  error  (THH).  Complex  Coordination,  an  ex¬ 
ample  of  control  precision  and  multilimb  coordination  (Fleishman  &  Quaintance,  19  34) 
was  the  second  psychomotor  test.  Using  the  right  hand  control  stick,  this  compensa¬ 
tory  tracking  task  required  the  subject  to  keep  a  ■!  in.  cross  centered  on  a  dotted-line 
cross  which  bisected  the  monitor  horizontally  and  vertically.  Simultaneously,  using  the 
left  hand  control  stick,  the  subject  had  to  keep  a  1  in.  verticai  bar  horizontally  centered 
at  the  base  of  the  moniior  display.  The  1  in.  cross  and  the  vertical  bar  were  forced 
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away  from  c©’-  r  by  a  random  function.  The  three  scores  for  this  test  were  horizontal 
tracking  dist  error  (CCH)  and  vertical  tracking  distance  error  (CCV)  for  the  1  in. 
cross  and  .ing  distance  error  (CCR)  for  the  1  ,  .  vertical  bar  The  thim 
psychomotor  test,  Time  Sharing,  was  identified  with  Fleishman  &  Quaintance's  (1984 
psychomotor  factors  of  reaction  time  and  rate  control.  In  the  first  10  min,  the  subjeci 
was  required  to  keep  randomly  movi-^g  cross  hairs  on  an  airplane  target  using  the 
right  hand  control  stick.  In  the  next  6  min  the  subject  had  to  repeat  the  tracking  task 
and  had  :o  cancel  digits  which  appeared  at  random  intervals  and  positions  on  the 
monitor  Cancellation  was  timed  and  consisted  of  pressing  the  correr  ^ding  digit  on 
the  numeric  keypad.  Tracking  task  difficulty  was  computer  adjusted.  .  .lailer  tracking 
errors  caused  the  stick  sensitivity  to  increase  and  larger  tracking  errors  caused  it  to 
decrease.  The  score  on  this  test  was  tracking  difficulty  during  digit  cancellation  (TSD). 
Electro-mechanical  versions  of  these  psychomotor  tests  were  administered  during 
World  War ..  and  ure  reported  by  Thorndike  and  Hagen  (1959). 

Information  processing  capacity  was  measured  y  Men.  Rotation  and  Item 
Recognition.  The  Mental  Rotation  measu  was  a  variauon  of  a  spatial  transformation 
task  (Shepard  &  Metzler,  1971)  which  required  the  subject  to  make  a  same-different 
judgment  about  two  sequential*  “-esented  letters.  Letter  pairs  were  either  oame  or 
mirror  images  and  in  the  same  orientation  or  rotated  in  relation  to  each  other.  A 
correct  "different  judgment"  is  associated  with  letters  being  mirror  images  and 
independent  of  rotation  while  a  correct  "same  judgment"  is  ai  ^iated  with  tbo  letters 
being  not  mirror  images  and  is  also  independent  of  rotation,  he  score  o  is  test 
was  average  response  time  adjusted  for  accuracy  (MRT).  If  the  responses  were  belov/ 
75%  correct,  the  reaction  time  score  was  set  to  2,500  ms.  Item  Recognition  was  a 
measure  of  short-term  memory  (Sternberg,  1966)  in  which  the  subject  was  presented 
with  a  group  of  1  to  6  numbers  which  was  then  removed  ^mm  the  display.  A  single 
number  was  then  prese-  ad  and  the  subject  had  to  specify  //hether  that  ni  her  was 
among  the  group  preset  ^d.  The  score  (ITT)  was  avt  rge  response  tir  'e  aujusted  for 
accuracy.  Again,  the  75%  correct  rule  was  applied  with  2,500  ms  recorded  for  all 
scores  below  this  minimum. 

The  Activities  Interest  Inventory  was  admin  .>tered  as  a  measure  of  attnude 
toward  risk  taking  (Mullins,  1962)  and  consisted  of  81  pairs  of  activities.  Each  pair 
contained  one  low-risk  and  one  high-risk  ac'  ’v.  The  subjects  chosf  Iween  them 
and  the  .scores  were  me  percent  of  high-risk  .livitlcs  chosen  (AlP)  ai.«-.  the  average 
response  time  (AIT)  for  making  the  choices. 

A  alf  report  of  the  number  of  flying  hoi'm  (FLYEX)  accrued  before  entrance  >  o 
the  Air  Force  was  collected.  The  criteria  wen  .ass-fail  (P/F)  in  UPT  and  class  rank.,,g 
based  on  flying  '  id  academic  grades  (RANK)  during  training. 

Procedures 

The  subjects  took  the  BAT  while  attending  a  basic  course  in  airmar 
includinr  flying  a  single  engine,  propeller-driven,  high-wing  light  aircraft.  They  then 
entered  LIFT  where  the  criteria  were  collected. 
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As  these  subjects  were  all  selected  on  the  basis  of  their  AFOQT  scores, 
educational  attainment,  i  nterest,  and  flight  screening  performance,  they  were  a  range- 
restricted  sample.  This  restriction  artificially  causes  the  correlations  to  be  downwardly 
biased  estimates  and  must  be  corrected.  Lawley's  (1943)  multivariate  correction  for 
range  restriction  was  applied  to  the  matrix  of  correlations  from  the  sample  to  make  it 
represent  the  expected  correlations  in  a  group  of  3,000  applicants  (Skinner  &  Ree, 
1987).  As  the  Skinner  and  Ree  sample  did  not  contain  correlations  involving 
education,  it  is  likely  that  the  corrected  matrix  is  still  an  underestimate  (Linn,  Harnisch, 
&  Dunbar,  1981)  of  the  population  values.  The  Lawley  correction  could  not  be  applied 
to  a  matrix  that  included  both  the  Pilot  composite  and  the  AFOQT  tests  due  to  linear 
dependency  among  these  variables.  Nor  could  the  Lawley  correction  be  applied  to 
the  Pilot  composite  alone,  and  a  series  of  univariate  corrections  (Thorndike,  1949) 
would  be  inappropriate.  Therefore,  the  matrix  of  correlations  including  the  Pilot 
composite  and  the  other  variables  is  downwardly  biased  and  underestimates  the  true 
values  of  the  correlations.  Test  scores  rather  than  composites  were  used  in  certain 
analyses  to  afford  maximum  prediction. 

Descriptive  statistics,  correlations,  and  regressions  were  computed  for  the 
sample.  Correlations  used  to  compute  the  regressions  involving  error  and  response 
time  scores  were  reflected  so  that  good  peiiormances  were  always  positively 
correlated.  To  determine  the  predictive  efficiency  of  types  of  variables,  linear  model 
analyses  were  conducted  (Ward  &  Jennings,  1973).  The  criteria  were  regressed  on 
each  aggregation  of  variables  of  a  specific  type  (i.e„  AFOQT,  psycliomotor,  information 
processing,  attitude  toward  risk,  and  flying  experience).  Using  pairs  of  full  and 
restricted  models,  the  incremental  validity  of  each  variable  type  was  tested  against  the 
baseline  of  the  operational  multiple  aptitude  test,  the  AFOQT.  Additionally,  a 
regression  model  that  contained  all  the  variables  was  tested  against  5  other  models 
that  contained  all  the  variables  except  one  type.  For  example,  a  regression  equation 
that  contained  all  the  variables  was  tested  against  a  regression  equation  that 
contained  all  the  variables  except  the  psychomotor  variables.  This  test  allowed  for  an 
estimate  of  the  unique  contribution  of  each  type  of  variable. 


RESULTS 


Examination  of  the  means  and  variances  of  the  AFOQT  scores  showed  that  the 
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when  compared  to  the  applicant  sample  (Skinner  &  Ree,  1987).  On  average,  the  test 
means  were  increased  by  .59  standard  deviation  units.  For  14  of  16  tests,  the 
variances  decreased  to  an  average  of  7(  ’/o  of  the  var.ance  of  the  applicant  sample. 
The  1C  and  Ai  tests  showed  an  average  increase  in  variance  to  105%  of  the 
applicant  sample  variance.  While  this  increase  was  unusual,  it  was  found  elsewhere 
in  the  literature  (see  Levin,  1972)  and  is  a  consequence  of  selectic.n  procedures.  The 
test  that  showed  the  greatest  reduction  in  variance  was  TR  which  is  simultaneously  on 
the  Pilot  and  Navigator-Technical  composites,  both  of  which  are  used  directly  in  pilot 
selection.  The  least  variance  restricted  tests  (not  including  the  2  which  showed 
increases  in  variance)  were  Dl  and  GS,  both  on  the  Navigator-Technical  composite. 
These  tests  showed  84%  of  the  applicant  sample  variance. 
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Due  to  the  size  of  the  correlation  matrix,  676  entries,  it  is  not  reproduced  here 
but  is  available  on  request.  The  uncorrocted  correlations  range  from  low  to  moderate 
with  unexpected  negative  correlations  on  the  aptitude  tests,  due  to  range  restriction. 
The  corrected  matrix  shows  less  downwardly  biased  estimates  and  stronger 
correlations.  Some  of  the  previously  negative  correlations  have  been  reestimated  to 
be  positive  in  keeping  with  the  Lawley  theorem  (Birnbaum,  Paulson,  &  Andrews, 
1950;  Lawley,  1943;  Ree  &  Carretta,  in  press). 

The  results  of  the  regression  analyses  are  shown  in  Table  1.  Almost  all  of  the 
variable  types  were  statistically  significant  predictors  of  the  criteria. 


Table  1.  Regression  Analyses  Using  AFOOT  Pilot  Composite 
(Uncorrected  Correlations) 


Scores 

N 

Scores 

_ R _ 

_ AJ3 _ 

UPT 

(P/F) 

Rank 

UPT 

(P/F) 

Rank 

AFOOT  Pilot 

1 

.168** 

.200** 

BAT  Psychomotor 

5 

.148* 

.158* 

BAT  Info  Proca 

2 

.058 

.027 

BAT  Risk® 

2 

.101* 

.108* 

Flying  Experience 

1 

.167** 

.1£  '** 

Pilot  and  Psychomotor  6 

.207** 

.238** 

.039 

.038* 

Pilot  and  Cognitive 

3 

.174** 

.206** 

.006 

.006 

Pilot  and  Risk 

3 

.203** 

.236** 

.035** 

.036** 

Pilot  and  Flying 

2 

.235** 

.274** 

.067** 

.074 

Experience 

All 

11 

.295** 

.333** 

.127** 

.133** 

®  Inic  Proc  is  information  processing  and  Risk  is  attitude  toward  risk. 
*P  <  .05 
**P  <  .01 


Incremental  validity  of  the  predictors  beyond  th  i  prediction  offered  by  the 
AFOOT  Pilot  composite  can  be  found  in  the  last  2  columns.  The  predictor  with  the 
greatest  incremental  validity  was  flying  experience.  The  type  of  predictor  with  the 
least  incremental  validity  was  information  prcnessing.  Incremental  validity  of  the 
predictors  's:  psycho  motor,  .039  for  P/F  and  .038  for  RANK,  information  process- 
i  g,  .006  fc.  Doth  criteria,  attitude  toward  risk,  .035  and  .036  tor  P/F  and  RANK,  and 
flying  experience  showed  the  greatest  incremental  validity  at  .067  and  .074  for  P/F 
and  RANK.  The  incremental  validity  of  all  the  variables  beyond  the  Pilot  composite 
was  .127  and  .133  for  P/F  and  RANK  as  criteria.  The  same  regressions  were 
computed  using  the  16  AFOOT  tests,  and  the  results  are  presented  in  Table  2.  The 
results  of  the  linear  models  analyses  where  one  type  of  variable  was  removed  and 
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compared  to  all  the  remaining  variables  are  presented  in  Tables  3  and  4.  The  results 
presented  in  Tables  2,  3,  and  4  closely  parallel  the  results  presented  in  Table  1 . 


Table  2.  Regression  Analyses  Using  AFOQT  Tests 
(Uncorrected  Correlations) 


" 

R 

A  R 

N 

UPT 

UPT 

Scores 

Scores 

(P/F) 

Rank 

(P/F) 

Rank 

AFOQT  Tests 

16 

.244“ 

.277“ 

BAT  Psychomotor 

5 

.148“ 

.158* 

BAT  Info  Proca 

2 

.058 

.027 

BAT  Risk® 

2 

.101* 

.108* 

Flying  Experience 

1 

.167“ 

.190“ 

AFOQT  and 

21 

.268“ 

.302“ 

.024 

.025 

Psychomotor 

AFOQT  and  Info  Proc 

18 

.247“ 

.280“ 

.003 

.003 

AFOQT  and  Risk 

18 

.268“ 

.307“ 

.024* 

.030“ 

AFOQT  and  Flying 
Experience 

19 

.291“ 

.330** 

.047** 

.053** 

All 

26 

.332“ 

.375** 

.088** 

.098 

®lnfo  Proc  is  information  processing  and  Risk  is  attitude  toward  risk. 
*P  <  .05 
**P  <  .01 


Table  3.  Uniqueness  Analyses  Using  AFOQT  Pilot  Compor'*e 
(Uncorrected  Correlations) 


N 

Scores  Scores 

1 

R 

_ 

UPT 

(P/F) 

Rank 

UPT 

(P/F) 

Rank 

1.  All 

11 

.295“ 

.333** 

r\lly  OAUOpl  1  llUi 

10 

i 

OQO** 

nci  ** 

,\j\j  { 

3.  All,  except 

6 

.251** 

.287“ 

.044** 

.046“ 

Psychomotor 

4.  All,  except  Info  Proc® 

9 

.292** 

.332“ 

.003 

.001 

5.  All,  except  Risk® 

9 

.283** 

.321“ 

.012 

.012 

6.  All,  except  Flying 

10 

.244** 

.277 

.051** 

.056“ 

Experience 

®lnfo  Proc  is  infomnation  processing  and  Risk  is  attitude  toward  risk. 
*P  <  .05 
**P<  .01 


6 


Table  4.  Uniqueness  Analyses  Using  AFOQT  Tests 
(Uncorrected  Correlations) 


N 

Scores  Scores 

_ B _ 

_ A 

UPT 

(P/F) 

Rank 

UPT 

(P/F) 

Rank 

1.  All 

26 

.332** 

.375** 

2.  All,  except  AFOQT 

10 

.261** 

.28'"* 

.071  ** 

.093** 

Tests 

3.  All,  except 

21 

.301** 

.342** 

.031* 

.033** 

Psychomotor 

4.  All,  except  Info  Proc^ 

24 

.331** 

.375** 

.001 

.000 

5.  Ail,  except  Risk^ 

24 

.323** 

.364** 

.009 

.011 

6.  All,  except  Flying 

25 

.296** 

.335** 

.036** 

.040** 

Experience 

^nfo  Proc  is  information  processing  and  Risk  is  attitude  toward  risk. 
*P  <  .05 
**  P  <  .01 


Regressions  were  also  computed  from  the  matrix  of  corrected  correlations 
using  the  AFOQT  tests  and  the  other  variables.  Ree,  Eatles,  &  Teachout  (1992)  have 
shown  that  alt*  ^ ugh  the  standard  error  of  corrected  correlations  is  not  precisely 
known,  the  sigs  jance  test  associated  with  the  difference  between  linear  models  is 
unaffected  by  the  Lawley  correction.  The  F  test  associated  with  the  difference  be¬ 
tween  linear  models  uses  only  error  sums  of  squares  which  are  not  changed  by  the 
correction. 

Table  5  shows  the  regressions  from  the  correu.  d  matrix  of  correlations.  The 
corrected  multiple  regressions  of  the  P/F  and  RANK  criteria  on  the  AFOQT  tests  were 
.308  and  .347,  respectively.  Flying  experience  added  the  largest  increment  to  the 
tests  at  .036,  for  P/F,  and  .041 ,  for  RANK,  increments  of  .019  (P/F)  and  .023  (RANK) 
were  found  for  the  measures  of  attitude  toward  risk  in  the  corrected  matrix.  Adding  the 
psychomotor  scores  from  Two-Hand  Coordination,  Complex  Coordination,  and  Time 
Sharing,  incremented  the  validity  of  the  AFOQT  tests  .018  and  .019  for  the  two  criteria 
P/F  and  RANK.  The  incremental  validity  of  the  information  processing  tests  was  .00: 
for  both  criteria.  The  increments  above  the  AFOQT  tests  provided  by  using  all  the 
variables  was  .071  for  P/F  and  .079  for  RANK. 
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Table  5.  Regression  Analyses  Using  AFOCT  Tests 
(Corrected  Correlations) 


Scores 

N 

Scores 

B _ 

_ AR _ 

UPT 

(P/F) 

Rank 

UPT 

(P/F) 

Rank 

AFCX3T  Tests 

16 

.308** 

.347** 

BAT  Psychomotor 

5 

.182** 

.192* 

BAT  Info  Proc» 

2 

.103* 

.084 

BAT  Risk* 

2 

.093* 

.099* 

Flying  Experience 

1 

.166** 

.187** 

AFOQT  and 

21 

.326** 

.366** 

.018 

.019 

Psychomotor 

AFOQT  and  Info  Proc 

18 

.310** 

.349** 

.002 

.002 

AFOQT  and  Risk 

18 

.327** 

.370** 

.019* 

.023** 

AFOQT  and  Flying 

17 

.344** 

.388** 

.036** 

.04^** 

Experience 

All 

26 

.379** 

.426** 

.071** 

.079** 

^nfo  Pfoc  is  information  processing  and  Risk  is  attitude  toward  risk. 
•P  <  .05 
•*P  <  .01 


It  is  appropriate  to  remember  that  these  regressions  and  increments  are 
susceptible  to  shrinkage  on  cross  application  and  we  have  calculated  the  expected 
cross  validity  by  application  of  Stein's  operator  (Kennedy,  1983).  The  expected  cross 
validity  of  the  corrected  correlations  decreased  by  no  more  than  .002,  a  trivial  amount. 

The  results  of  removing  one  variable  type  and  testing  its  uniqueness  for 
prediction  of  the  criteria  were  consistent  with  the  linear  models  analyses.  Tables  3,  4, 
and  6  show  these  results. 

Removing  flying  experience  from  the  regression  containing  all  the  variables 
(using  the  Pilot  composite;  see  Table  3)  caused  the  largest  drops  in  predictive 
efficiency,  .051  (P/F)  and  .056  (RANK).  In  both  the  un^orrected  (Table  4)  and 
corrected  (Table  6)  matrices,  removal  of  the  AFOQT  tbsts  caused  the  largest 
decrements. 
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Table  c.  Uniqueness  Analyses  Using  Corrected  Correlations 


i 

R 

A  R 

N 

UPT 

UPT 

Scores 

Scores 

(P/F) 

Rank 

(P/F) 

Rank 

1.  All 

26 

.379** 

.426** 

2.  Ali,  except  AFOOT 

10 

.288** 

.307** 

.091** 

.119** 

Tests 

3.  All,  except 

21 

.353** 

.399** 

.026* 

.027** 

Psychomotor 

4.  All,  except  Info  Proc**  24 

.378** 

.426** 

.001 

.000 

5.  All.  except  Risk® 

24 

.371** 

.416** 

.008 

.010 

6.  All,  except  Flying 

25 

.349** 

.392** 

.0''0** 

.034** 

Experience 

^nfo  Proc  is  information  processing  and  Risk  is  attitude  toward  risk. 
*P  <  .05 
**P  <  .01 


DISCUSSION 

Although  the  information  processing  tests  were  not  incremental  to  either  the 
AFOOT  Pilot  composite  or  AFOOT  tests  or  the  other  variables,  they  have  been  found  to 
be  incremental  in  a  previous  sample  (Carretta,  1992).  The  reason  for  their  lack  of 
incremental  validity  may  be  the  rather  severe  disproportionality  {8o.7%  passed  flying 
training)  of  the  P/F  criterion  in  this  sample  which  is  a  subset  of  the  sample  in  which 
they  were  previously  found  to  be  incremental.  The  difference  between  the  two 
samples  aside  from  the  split  proportions  was  the  requirement  that  the  current  sample 
contain  the  RANK  criterion  for  each  subject.  Under  circum.stances  of  less  criterion 
disproportionriity,  they  seem  to  be  incrementally  valid  predictors. 

The  relatively  low  incremental  validity  of  the  psychomotor  tests  is  consistent 
with  previous  findings  (Ree  &  Carretta,  in  press)  which  showed  them  to  be  g-loaded. 
They  did,  howeve  offer  unique  predictive  efficiency  not  provided  by  other  variables. 

That  flying  experience  was  the  most  incrementally  predictive  variable  came  as 
no  surprise  (Stoker,  Hunter,  Kantor,  Quebe.  &  Siem,  1987).  Additionaily,  removing 
flying  experience  from  the  models  with  all  the  variables  (Pilot  composite  used)  lead  to 
the  greatest  decrement  in  predictive  efficiency.  Flying  training  exposes  individuals  to 
information  aboul  aircraft  and  may  serve  as  a  sc  aenirig  device  to  weed  out  those  with 
the  least  motivation,  those  who  engender  fear  of  flying,  and  those  who  cannot  learn  to 
handle  the  aircraft  properly.  However,  flying  training  is  expensive  and  may  also 
screen  out  notentially  successful  pilots  due  to  lack  of  income  or  opportunity  to  pursue 
flying  traini  g. 


9 


Attitude  toward  risk  (AlP,  AIT)  was  incrementally  valid  beyond  both  the  AFOOT 
Pilot  composite  and  the  16  AFOOT  tests.  However,  what  it  truly  measures  cannot  be 
said,  but  its  incremental  validity  compels  further  study.  This  test  should  be 
administered  as  part  of  a  factor  reference  study  among  a  series  of  personality  marker 
tests.  Further,  its  susceptibility  to  faking  and  providing  responses  which  are  socially 
desirable  should  be  evaluated. 

The  greatest  loss  in  prediction  was  found  when  the  16  ter^s  of  the  AFOOT  were 
removed  from  regressions  containing  all  variables.  These  regression  models  were 
not  without  their  problems,  though.  Operationally  the  Air  Force  uses  the  Pilot 
composite  although  other  options  could  be  considered.  Many  of  the  regression 
coefficients  were  negative  and  in  application  this  would  cause  problems.  Some  of  the 
variables  would  be  easy  to  compromise  by  not  responding  to  them.  Also,  some  of  the 
negative  weights  would  penalize  the  good  performance  encouraged  by  the  test 
administration  instructions. 

The  paper-and-pencil  tests  were  the  most  predictive  variables.  Flying 
experience,  psychomotor,  and  attitude  toward  risk  all  contributed  to  the  prediction  of 
the  criteria.  Information  processing  failed  to  be  a  valid  predictor  and  should  be 
evaluated  for  revision  or  discarded. 
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